Physics-Informed Neural Networks (PINNs) have gained much attention in various fields of engineering thanks to their capability of incorporating physical laws into the models. PINNs integrate the physical constraints by minimizing the partial differential equations (PDEs) residuals on a set of collocation points. The distribution of these collocation points appears to have a huge impact on the performance of PINNs and the assessment of the sampling methods for these points is still an active topic. In this paper, we propose a Fixed-Budget Online Adaptive Mesh Learning (FBOAML) method, which decomposes the domain into sub-domains, for training collocation points based on local maxima and local minima of the PDEs residuals. The stopping criterion is based on a data set of reference, which leads to an adaptive number of iterations for each specific problem. The effectiveness of FBOAML is demonstrated in the context of non-parameterized and parameterized problems. The impact of the hyper-parameters in FBOAML is investigated in this work. The comparison with other adaptive sampling methods is also illustrated. The numerical results demonstrate important gains in terms of accuracy of PINNs with FBOAML over the classical PINNs with non-adaptive collocation points. We also apply FBOAML in a complex industrial application involving coupling between mechanical and thermal fields. We show that FBOAML is able to identify the high-gradient location and even give better prediction for some physical fields than the classical PINNs with collocation points taken on a pre-adapted finite element mesh.

对于适当的统计估计，数据集中的偏差可能非常有害。为了应对这个问题，已经开发了重要的加权方法，以将任何有偏分的分布与其相应的目标无偏分布相匹配。如今，开创性内核平均匹配（KMM）方法仍然被认为是该研究领域的最新技术。但是，该方法的主要缺点之一是大型数据集的计算负担。基于Huang等人的先前作品。 （2007）和De Mathelin等。 （2021），我们得出了一种新颖的重要性加权算法，该算法通过使用神经网络预测实例权重来扩展到大型数据集。我们在多个公共数据集上显示，在各种样本偏见下，我们提出的方法大大减少了大数据集上的计算时间，同时与其他重要的加权方法相比，保持了相似的样本偏差校正性能。所提出的方法似乎是唯一能够在合理时间内使用多达200万个数据的大型数据集进行相关重新加权的方法。

物理知识的神经网络（PINNS）由于能力将物理定律纳入模型，在工程的各个领域都引起了很多关注。但是，对机械和热场之间涉及耦合的工业应用中PINN的评估仍然是一个活跃的研究主题。在这项工作中，我们提出了PINNS在非牛顿流体热机械问题上的应用，该问题通常在橡胶日历过程中考虑。我们证明了PINN在处理逆问题和不良问题时的有效性，这些问题是不切实际的，可以通过经典的数值离散方法解决。我们研究了传感器放置的影响以及无监督点对PINNS性能的分布，即从某些部分数据中推断出隐藏的物理领域的问题。我们还研究了PINN从传感器捕获的测量值中识别未知物理参数的能力。在整个工作中，还考虑了嘈杂测量的效果。本文的结果表明，在识别问题中，PINN可以仅使用传感器上的测量结果成功估算未知参数。在未完全定义边界条件的不足问题中，即使传感器的放置和无监督点的分布对PINNS性能产生了很大的影响，我们表明该算法能够从局部测量中推断出隐藏的物理。

设计具有所需特性的新工业材料可能非常昂贵且耗时。主要困难是生成对应于现实材料的化合物。实际上，作为组分的载体的化合物的描述的表征是通过离散特征和严重的稀疏性表征。此外，传统的生成模型验证过程作为视觉验证，FID和开始分数是针对图像量身定制的，然后不能在此上下文中使用。为了解决这些问题，我们开发了一种致力于产生高稀疏性的离散数据集的原始绑定-VAE模型。我们通过适应化合物生成问题的新型度量来验证模型。我们展示了橡胶复合设计的真正问题，即所提出的方法优于标准生成模型，该模型开启了用于材料设计优化的新视角。

本文的目的是设计主动学习策略，从而在Lipschitz函数的假设下导致领域适应。以Mansour等人的先前作品为基础。（2009年）我们调整了源和目标分布之间的差异距离的概念，以将假设类别的最大化限制为在源域上执行准确标记的局部函数类别的最大化。我们根据Rademacher平均值和满足规律性条件的一般损失函数的局部差异来得出此类主动学习策略的概括误差界限。可以从理论界限推断出可以解决大数据集情况的实用k-媒体算法。我们的数值实验表明，在域适应性的背景下，所提出的算法与其他最先进的活跃学习技术具有竞争力，尤其是在大约十万张图像的大数据集上。

Vision Transformers convert images to sequences by slicing them into patches. The size of these patches controls a speed/accuracy tradeoff, with smaller patches leading to higher accuracy at greater computational cost, but changing the patch size typically requires retraining the model. In this paper, we demonstrate that simply randomizing the patch size at training time leads to a single set of weights that performs well across a wide range of patch sizes, making it possible to tailor the model to different compute budgets at deployment time. We extensively evaluate the resulting model, which we call FlexiViT, on a wide range of tasks, including classification, image-text retrieval, open-world detection, panoptic segmentation, and semantic segmentation, concluding that it usually matches, and sometimes outperforms, standard ViT models trained at a single patch size in an otherwise identical setup. Hence, FlexiViT training is a simple drop-in improvement for ViT that makes it easy to add compute-adaptive capabilities to most models relying on a ViT backbone architecture. Code and pre-trained models are available at https://github.com/google-research/big_vision

Most benchmarks for studying surgical interventions focus on a specific challenge instead of leveraging the intrinsic complementarity among different tasks. In this work, we present a new experimental framework towards holistic surgical scene understanding. First, we introduce the Phase, Step, Instrument, and Atomic Visual Action recognition (PSI-AVA) Dataset. PSI-AVA includes annotations for both long-term (Phase and Step recognition) and short-term reasoning (Instrument detection and novel Atomic Action recognition) in robot-assisted radical prostatectomy videos. Second, we present Transformers for Action, Phase, Instrument, and steps Recognition (TAPIR) as a strong baseline for surgical scene understanding. TAPIR leverages our dataset's multi-level annotations as it benefits from the learned representation on the instrument detection task to improve its classification capacity. Our experimental results in both PSI-AVA and other publicly available databases demonstrate the adequacy of our framework to spur future research on holistic surgical scene understanding.

Pixel-level labels are particularly expensive to acquire. Hence, pretraining is a critical step to improve models on a task like semantic segmentation. However, prominent algorithms for pretraining neural networks use image-level objectives, e.g. image classification, image-text alignment a la CLIP, or self-supervised contrastive learning. These objectives do not model spatial information, which might be suboptimal when finetuning on downstream tasks with spatial reasoning. In this work, we propose to pretrain networks for semantic segmentation by predicting the relative location of image parts. We formulate this task as a classification problem where each patch in a query view has to predict its position relatively to another reference view. We control the difficulty of the task by masking a subset of the reference patch features visible to those of the query. Our experiments show that this location-aware (LOCA) self-supervised pretraining leads to representations that transfer competitively to several challenging semantic segmentation benchmarks.

Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License.

我们总结了Pirounet的模型和结果，PirOnet是一种半监督的复发性自动编码器。鉴于少量用定性编舞注释标记的舞蹈序列，Pirounet有条件地以编舞家的风格生成舞蹈序列。